If you know the records that are wrong, then you may be able to delete them from cache without restarting your nameserver or flushing the entire cache.
The cache is held only in RAM. However you can view it with rndc dumpdb -cache which will be saved (on Debian and Ubuntu) by default to /var/cache/bind/.
rndc flush flushes the server's cache. You cannot go and edit what is already there. If this is a local zone, freeze it, edit it and increase the serial number.